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ABSTRACT 



The invention relates to an image sequence coding method 
in which images are segmented and coded with respect to 
their contours and textures. The texture coding step is 
carried out by means of a lattice vector quantization method 
adapted to region-based coding schemes where regions have 
arbitrary shapes, for applications allowing to reach very low 
bit rates while keeping a good image quality. 

8 Claims, 3 Drawing Sheets 
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REGION -BASED TEXTURE CODING is complex and the approximation of a vector by an element 

METHOD AND DECODING METHOD, AND in a Urge codebook requires a significant processing time, 

CORRESPONDING SYSTEMS since for each vector, the entire dictionary must be browsed 

to find the best match in terms of distance. 

BACKGROUND OF THE INVENTION 5 To mitigate these drawbacks, a sub-optimal vector quan- 

A . 4 . . „ i « * j ■ tization having however a good efficiency can be used where 

THe present invention relates to a method of coding ^ ^ 6 is a )attice ^ tizat / on is referred to as 

images of an image sequence composing the following ^ ^ vcctor quantiza v Uon> H 01 LVQ) A lattice ^ m array 

" ' of points located at even distances in a n-dimensional space, 

(A) segmentation of each current image into homoge- 1Q i. e . a lattice is composed of all integral combinations of a set 
neous regions; 0 f i mcar [y independent vectors. For instance, a lattice D(n) 

(B) coding of the contours of said regions; is defined as: 

(C) coding of the textures of said regions. It also relates 

to a corresponding decoding method, and to systems D(n)-f tozY(.R m jY~ a* \ ^ 

for implementing said coding and decoding methods. 15 \ /=i " J 

This invention finds applications in the field of very low , . . . . , 

. A -j j. j. 4 . t , ; 4 . where a.,, a,, . . . , a„ are said vectors id the m-dimensional 

bitrate video coding and is particnlarly attracUve in relation ^ — ^ are k z . 

to the emerging coding standard MPEG4 supporting new „ t . 5" j * . i 

£ 6 & . b , ■ i r j- % 1 Some authors have proposed a fast quantization algorithm 

ways for communication, access and manipulation ot digital r . , , , „. w \ * i 

j . ■ i j . for the LVQ based upon the lattice D(n): a vector with real 

audio-visual data. 20 . . r . 4 , . . v ; . 4 . 

A 4 . . , . i * i coordinates is approximated by the two closest integer 

Among the recent image coding techniques, those which 4 , * * • .1 ^ i_ 1 • ^ 

. , j 4 * & ■ • -n • n *u vectors, and the representant m the codebook is the one with 

are region-based seem to be very promising. Basically, they ' „, r . ~. , . , . 

. & 4 , 4 I-- * *l ■ ru j . / an even sum. The search of the representant in the codebook 

rely on three steps. First, the images are sphtted into . . * i j u i t j . 

, 3 - /■ . c i j / . ■ \ - is thus very simple even for large codebooks. In order to 

homogeneous regions (in terms of colour and/or motion) in a codebook of finite size, the lattice may be truncated 

order to get a partition of adjacent regions. Then, the 25 f . + . t t ' « .u 

& f ,u • * "u j i il i #. 4 (in practice, only the vectors of energy smaller than a given 

contours of the regions are transmitted. In the last step, vr r Jt ^ j ■ 

„ , , , j- 4i_ i - r * * 4 jt energy, referred to as Truncated Energy below and in FIG. 

called texture coding, the colour information is transmitted. - * J \ A . .. . ° ; ( , „. , . 

„, , r • i_ j * *. t • , 2, are kept). Moreover, to optimize the trade off between 

The goal of a region-based texture coding procedure is to \ . r ' A . . « . . ^ , „ 

, iX _ 1, ! r T- • j i. minimum distortion and bit rate, the lattice is scaled. To 

encode the grey-level or colour information inside each - it _ iL . V . . _^ 

f & . ^ .... A . ii u • encode the vectors, they are projected on or within surfaces 

region of an image partition. As schematically shown in 30 , t ^ ' . J * . ? e , A , „ , 

„ T % ^ ii * r /-m - /— i -.^ - « * of constant energy using a scaling factory. A surface called 

FIG. 1, generally a transform (TR, m FIG. 1) is first . , , , ! . 4 & .. . ^ fl , . 

r ? . . • * ^ iL > r *i_ ■ ■ i - pyramid for the laplacian distribution is defined by 

performed on the pixels of the regions of the original image rj r J 

(ORIM) in order to get coefficients which are more suited for fin \ 1 

quantization and encoding (for instance, a discrete cosine Surfece(energy) - \ (x tR n )f( I energy ) I 

transform, which allows the texture information to be rep- 35 IV* 01 / J 

resented in the frequency space, or a shape-adaptive wavelet The main following steps are then performed at the 

transform, which allows to get coefficients in the space/ encoding side: 

frequency plane). Then these coefficients are quantized (Q) truncate the lattice in order to define the dictionary size; 

and finally a bitstream is generated by an atopy coder k ^ j f fa b d d 

(COD) and sent to the transmission channel (TRCH). At the 40 &/ 

decoder side, the inverse operations (entropy decoding DEC, P ro J ect ^ vectors of ener gy lower or equal 

inverse quantization Q" 1 , inverse transform TR" 1 ) are per- to ^ maximal energy in the truncated lattice by 

formed to yield a reconstructed image (RECIM), as also dividin S b ? Y«Maximal Energy^mncated Energy; 

illustrated in FIG. 1. project the source vectors of energy higher than the 

Among all the techniques described for the quantization 45 maximal energy on the surface of the truncated lattice 

of the transformed coefficients, the lattice vector quantiza- by scaling them by an appropriate normalization 

tion (LVQ) has proved to be a good compromise between parameter a and send it to the decoder; 

coding cost and computation time. This technique, described send to the decoder the index of the nearest lattice vector 

for example in "A Lattice Vector Quantization Using a which has been determined by applying the fast quan- 

Geometric Decomposition", T. C. Chen, IEEE-Transactions so tization algorithm. 

on Communications, vol.38, n°5, May 1990, pp.704- 714, is FIG. 2, which schematizes an LVQ encoding phases for a 

often used to quantize wavelet coefficients and has been built D(2) lattice, shows three input vectors xl, x2, x3 (indicated 

in the framework of block-based structures. Vector quanti- by small circles) and the quantization of these input vectors 

zation relies on the approximation of blocks of pixels (the quantized vectors Ax are indicated by small squares): xl 

(referred to as "the vectors" below) by representants belong- 55 has an energy greater than the maximal energy ME 

ing to a catalogue constituting a set of reproduction vectors (indicated by the dotted line while the truncated one is 

and also called the codebook: for the purposes of transmis- indicated by the reference TE), x2 has an energy equal to the 

sion and/or storage, a binary codeword called the index is maximal energy, and x3 has an energy lower than the 

associated to each considered data vector. At the receiving maximal energy. 

and decoding side, a vector quantizer then associates a 60 The dequantization is the inverse process of the quanti- 

reproduction vector of the codebook to the index that has zation. It relies on two steps: (a) find the lattice vector 

been transmitted and/or stored. The well known LBG associated to the index, and (b) rescale the lattice vector by 

algorithm, often used to design a vector quantization code- the inverse scaling factor l/ r 

book and described for instance in "An Algorithm for Vector When dealing with block-based schemes, the transformed 

Quantizer Design", Y Linde and al, IEEE-Transactions on 65 coefficients are grouped in blocks, and each block forms a 

Communications, vol.28, n°l, January 80, pp.84-95, has vector that will be quantized according to the process 

two drawbacks : the creation of a codebook for high bit rates described above. For instance, in the case of the lattice D4, 
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which is often used in the experiments, the input vectors to decoding means for decoding the coded signals corre- 

be quantized by LVQ are split into blocks of size 2x2. This sponding to the contours of the. regions; 

allows to benefit from the vertical and horizontal correla- decoding means for decoding the coded signals corre- 

tions of the transformed coefficients. However, in the case of sponding to the textures of the regions; 

region-based schemes, this splitting cannot be performed 5 recoastruction means for restitution of images corre- 

since the regions have arbitrary shapes. spoDding to the original ones; 

SUMMARY OF THE INVENTION wherein said reconstruction means comprise, for said 

- , . restitution, a processor carrying out in an iterative manner 

It is a first object of the invention to propose a new for each re ^ 0Q ^ following opera tions: 

region-based texture coding method, based on an adaptation 10 / . , p A . „ A 

of the lattice vector quantization (LVQ) to region-based < a ) talldm 8 o£ smallest rectangle surrounding the 

schemes dealing with arbitrary shapes. ^""f re SI on _ and SpMting Sud reCtangle lnt ° 

ii- » i ii d jocks or size ^x.z. 

At this end the invention relates to a coding method as „ v „ . 

described in the preamble' of the description and wherein < b > ^ch block determination of the vector size, 

said texture coding step comprises the following five is selecUon of a codebook con-espoodmg to said vector 

operations, performed for each region aze ' md latUce veclor ^quantization of each vector. 

(a) building of the smallest rectangle surrounding the BRIEF DESCRIPTION OF THE DRAWING 
considered region; 

(b) splitting of the rectangle in blocks of size 2x2; T^s* other as P ects of ^ invention will be apparent 

/ ~e t , nnpfnfmo j ; n « A ^ w ~f <-™ 1 20 fr° m an ^ elucidated with reference to the embodiments 

(c) storage of transformed coefficients in vectors or size 1, , ., , . . ? 

n -a Z a described hereinafter. 
2, 3 or 4 

(d) selection of the codebook corresponding to the vector In the Swings: 

size; FIG. 1 shows schematically a texture encoding and 

(e) lattice vector quantization of the current vector; the 25 decoding structure; 

operations (c) to (e) being carried out for each block FIG. 2 illustrates the LVQ encoding procedure for a D(2) 

previously transformed in order to get said coefficients. lattice; 

Such a method presents an efficient splitting of the FIGS. 3 and 4 illustrate schematically a shape-adaptive 

regions, which allows to adapt to arbitrary shapes while lattice vector quantization at the coding side and at the 

handling correlated transformed coefficients blocks. 30 decoding side respectively; 

It is another object of the invention to propose a coding FIG 5 illustrates a region splitting in blocks of size 2x2; 

system for implementing this method. ^ illustrates the storage of the vectors to be quan- 

At this end the invention relates to a system for coding & ^ 
images of an image sequence, comprising: 

segmentation means for defining in each successive cur- 35 DETAILED DESCRIPTION OF THE 

rent image homogeneous regions; PREFERRED EMBODIMENTS 

contour and texture coding means for respectively coding „ . n , . . . , . 

4l _ 1 j ,< i , c *l • r • j Basically, the proposed implementation relies on the use 

the contours and the textures of the regions 01 said - nr .(\ ... r *7 . . . -u j * j * -i u * 

& of the D(4) lattice, which will be described in details, but it 

image, can be extended easily to the general case of D(n) lattices, 

wherem said textare coding means comprise a processor « ae sameprocessis performed for each region (arrowA) of 

carrying out in an iterative manner for each region the 4 , ^m- j-j-aj - i-t^c* 1 j a 

f 11 • t - the image partition and is depicted in FIGS. 3 and 4 

wing opera 10ns. corresponding respectively to the encoding and decoding 

(a) building of the smallest rectangle surrounding the sides 

considered region and splitting said rectangle into „. , n . . , f , . . * A 

blocks of size 2x2* 45 First, the smallest rectangle of even horizontal and ver- 

oc 0 size x , ^ ca ^ jgjjgjjj surrounding the current region is determined 

(b) for each block, storage of transformed coefficients in (BSMR? fof building of the smaUest rectangle)) ^ s 
vectors of size 1, 2, 3 or 4, selection of a codebook rectang i e is splitted (rectangle splitting RSPL) into blocks of 
corresponding to said vector size, and lattice vector size 2x2 , as sn0 wn in FIG. 5 showing a current region CR 
quantization of each vector. $Q md said smaUest rec tangle SMR. For each block, the 

It is another object of the invention to propose a method transformed coefficients belonging to the current region are 

appropriate for decoding signals coded according to said stored (coefficicnt storage CST0 ) in a vector to be 

coding method, and a corresponding decoding system. quantized, the size of which depends on the number of 

At this end the invention relates to both a method of coefficients (the same scanning is used at the coding and 

decoding coded signals corresponding to images of a 5$ decoding sides: from the left to the right and from the top to 

sequence that have been coded by way of a method as the bottom> md FIG. 6 illustrates this step). Thus, vectors to 

described above, wherein said decoding method comprises be quantized (ab> abc ^ abcd> . . . ) 0 f size 1, 2, 3 or 4 are built, 

the following five steps, performed for each region: Regarding the lattice vector quantization, it means that an 

(a) building of the smallest rectangle surrounding the appropriate codebook corresponding to the vector size has 
concerned region; 60 then to be chosen for the quantization (codebook selection): 

(b) splitting of the rectangle in blocks of size 2x2; D(l), D(2), D(3) or D(4), according to the current vector 

(c) determination of the vector size; size. Finally a lattice vector quantization LVTQ of the 

(d) selection of the codebook corresponding to the vector current vector is carried out. The three last operations are 
size; performed for each block (arrow B). 

(e) lattice vector dequantization; the operations (c) to (e) 65 The decoding process is very similar to the coding one. 
being carried out for each block, and to a corresponding The regions are splitted (RSPL) into blocks of size 2x2 
system comprising: contained in the smallest rectangles surrounding them 
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(BSMR). Then, after a determination of the vector size 
(DVTS), the number of pixels belonging to the region in 
each block indicates (see FIG. 6) which codebook has to be 
selected (CSEL) for the final lattice vector dequantization 
(LVDQ). 

The present invention is not limited to these coding and 
decoding methods from which modifications or improve- 
ments can be deduced without departing from the scope of 
the invention. 

The same scheme can be for instance slightly modified to 
be used with any lattices D(n), with n >1 . In the general case, 
a splitting of the smallest rectangle surrounding the current 
region in blocks of n pixels can be considered. This involves 
the use of n codebooks in the lattice vector quantization: 
D(l), D(2), . . . D(n). 

Moreover, the invention also relates to corresponding 
coding and decoding systems. It is clear that the proposed 
coding method can be implemented in several manners, such 
as with the aid of wired electronic modules or, preferably, in 
the form of a coding system including a processor or a 
microprocessor that ensures the performance of series of 
instructions corresponding to the operations previously 
described in relation with the coding method and carried out 
within such electronic modules. Similarly the corresponding 
decoding method may be implemented in several manners 
and especially by way of a decoding system including 
processing means for performing the instructions corre- 
sponding to the above-described operations. 

It must also be said that most often, lattices of the type 
D(n) are used for the lattice vector quantization. 
Nevertheless, the proposed methods do not depend on this 
type of lattice. The process presented above remains avail- 
able whatever the lattice to be used. 

We claim: 

1. A method of coding images of an image sequence, the 
method comprising the following steps: 

(A) segmenting each image in the image sequence into 
homogeneous regions comprised of textures and con- 
tours; 

(B) coding the contours of said regions; and 
(Q coding the textures of said regions; 

wherein, for each region, said texture coding step com- 
prises: 

(a) building a smallest rectangle surrounding the 
region; 

(b) splitting the rectangle into 2x2 blocks; 

(c) storing transformed coefficients for each of the 2x2 
blocks in vectors having sizes defined as 1, 2, 3 or 4; 

(d) selecting a codebook for each vector, the selecting 
step selecting a codebook for each vector that cor- 
responds to a size of the vector; and 

(e) performing lattice vector quantization on each vec- 
tor in accordance with the codebook selected in the 
selecting step. 

2. A decoding method for decoding signals corresponding 
to images of an image sequence that have been coded using 
the method of claim 1, wherein said decoding method 
comprises the following steps, which are performed for each 
region of a coded image: 
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(a) building a smallest rectangle surrounding the region; 

(b) splitting the rectangle into 2x2 blocks; 

(c) determining sizes of vectors which store transformed 
coefficients for each one of the 2x2 blocks; 

(d) selecting a codebook, for each vector, that corresponds 
to a size of the vector; and 

(e) performing lattice vector dequantization on each vec- 
tor in accordance with the codebook selected in the 
selecting step. 

3. A method according to claim 1, wherein the rectangle 
built in the building step has equal horizontal and vertical 
dimensions. 

4. A method according to claim 1, wherein the regions 
have arbitrary shapes. 

5. A system for coding images of an image sequence, the 
system comprising: 

segmentation means for defining homogeneous regions in 
each image in the image sequence; 

contour coding means for coding contours of the regions 
of each image; and 

texture coding means for coding textures of the regions of 
each image, said texture coding means comprising a 
processor which, for each region, (a) builds a smallest 
rectangle surrounding the region, (b) splits said rect- 
angle into 2x2 blocks, (c) stores transformed coeffi- 
cients for each of the 2x2 blocks in vectors having sizes 
defined as 1, 2, 3 or 4, (d) selects a codebook for each 
vector corresponding to a size of the vector, and (e) 
performs lattice vector quantization on each vector in 
accordance with a selected codebook. 

6. A decoding system for decoding coded signals corre- 
sponding to images of an image sequence that have been 
coded in the coding system of claim 5, said decoding system 
comprising: 

contour decoding means for decoding coded signals cor- 
responding to contours of the regions; 

texture decoding means for decoding coded signals cor- 
responding to textures of the regions; and 

reconstruction means for reconstructing images that cor- 
respond to original images in the image sequence based 
on decoded signals from the contour decoding means 
and the texture decoding means, said reconstruction 
means comprising a processor which, for each region, 

(a) builds a smallest rectangle surrounding the region, 

(b) splits said rectangle into 2x2 blocks, (c) determines 
sizes of vectors which store transformed coefficients for 
each one of the 2x2 blocks, (d) selects a codebook for 
each vector, that corresponds to a size of the vector, and 
(e) performs lattice vector dequantization on each vec- 
tor in accordance with a selected codebook. 

7. A system according to claim 5, wherein the rectangle 
built by the processor has equal horizontal and vertical 
dimensions. 

8. A system according to claim 5, wherein the regions 
have arbitrary shapes. 
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